:So should I just re-adjust it or get a new tensioner?
You'll have to readjust it no matter what you choose. Most get into trouble because the belt is too tight vs too loose. If your idler gap closes while its running you're risking a broken idler stud